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BACKGROUND OF THE INVENTION 
5 Field of the Invention 

The present invention relates generally to non-photorealistic rendering (NPR) of images, 
and, more particularly, to a system, method, and apparatus for creating primitives for a 3- 
dimensional model in real-time. 
Description of the Related , Art 
10 There are embodiments in the art v^hich add primitives such as motion lines to line 

a ^ 

Jl drawings. For example, motion lines have been added to cartoon animations to give the 

'H.J. 

4^ appearance of motion or to emphasize a particular object's motion in the animation. In such an 

¥^ 

embodiment, motion lines are typically employed to make the movement of such objects appear 
J^" as realistic, or "photo-realistic," as possible. 

ir1 5 There are other embodiments in which primitives such as motion lines are automatically 

yi added to line drawings. In such embodiments, motion lines are added to static scenes at 
Q authoring time and then applied and rendered. The direction and other characteristics of each 
line, such as visibility and perspective correctness, are calculated at the authoring time from 
attribute information stored for each object to which motion lines are to be drawn for each frame. 
20 Such embodiments use key-frame data, where all of the attribute data for each object to which 
motion lines are to be dravm is stored within a file or memory separately for each frame. Since 
this attribute information is processed separately for each frame, such an embodiment consumes 
much of a system's resources. 
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An embodiment which relies less on a system's resources is therefore desired, so 
primitives such as motion lines may quickly be added to a frame. It is desirable to have an 
embodiment capable of processing a series of successive frames in an animation, for example, in 
which motion lines are not merely calculated from stored attribute information at authoring time 
for each frame. An improved embodiment would use, in addition to key-frame data, per-frame 
data, or data relating to the position and movement of an object in an animation based upon the 
position of the object in previous frames. 

It is also desirable to add primitives such as motion lines not only to a line drawing, but 
also to a 3-dimensional (3-D) model with polygonal geometry. It is desirable for such a system 
to use both per-frame data and key-frame data. A system using per frame data calculates motion 
lines based upon the positions of objects to which they attach in previous frames. Thus, physics 
can be applied to objects in each frame, and motion can be illustrated by resultant motion hnes 
based upon the positions of objects in a series of frames, unlike previous systems, which 
calculate positions and other physical properties separately for each frame. 

An embodiment is desired in which primitives such as motion lines may be added in real 
time. Therefore, an embodiment in which speed is optimized is desired. 
Brief Description of the Drawings 

FIG. 1 A illustrates a first position of a sphere according to an embodiment of the present 
invention; 

FIG. IB illustrates a second position of a sphere to which motion lines have been added 
according to an embodiment of the present invention; 

FIG. 2 illustrates an overview of a system according to an embodiment of the present 
invention; 




FIG. 3 is a flow chart showing the information determined before real time motion lines 
are drawn according to an embodiment of the present invention; 

FIG. 4A illustrates a first iteration of a ring buffer span in which data for a vertex to 
which a motion line is to be added is stored over a three-frame span according to an embodiment 
5 of the present invention; 

FIG. 4B illustrates a second iteration of a ring buffer span in which data for a vertex to 
which a motion line is to be added is stored over a three-frame span according to an embodiment 
of the present invention; 

FIG. 4C illustrates a third iteration of a ring buffer span in which data for a vertex to 

10 which a motion line is to be added is stored over a three-frame span according to an embodiment 

CI 

■ai of the present invention; 

4; FIG. 5 illustrates a motion line and each of the line segments comprising the motion line 

according to an embodiment of the present invention; 

FIG. 6 illustrates a process of adding motion lines to a drawing according to an 
hi 5 embodiment of the present invention; 

J| FIG. 7 illustrates a process by which motion lines are automatically added to objects 

Q exceeding a threshold velocity in a frame of a series of frames according to an embodiment of 
the present invention; 

FIG. 8 illustrates a process by which vertices are automatically determined by a process 
20 according to an embodiment of the present invention; 

FIG. 9A illustrates a solid box-shaped object, travelling at a first constant velocity, to 
which parallel motion lines have been drawn, according to an embodiment of the present 
invention; 
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FIG. 9B illustrates a solid box-shaped object, travelling at a second constant velocity, to 
which parallel motion lines have been drawn, according to an embodiment of the present 
invention; 

FIG. 9C illustrates a solid box-shaped object, travelling at a third constant velocity, to 
5 which parallel motion lines have been drawn, according to an embodiment of the present 



FIG. lOA illustrates a first position of a solid box-shaped object according to an 
embodiment of the present invention; 

FIG. lOB illustrates a second position of a solid box-shaped object which is moving away 
10 from its first position and experiencing a positive angular velocity in a coimter-clockv^se 

17- 

1 direction, to which motion lines have been drawn according to an embodiment of the present . 
Z invention; 



invention; 




monster according to an embodiment of the present invention; 



FIG. 1 1 A illustrates a first position of stars with motion lines circling above the head of a 




:i5 



of a monster according to an embodiment of the present invention; and 



FIG. lie illustrates a third position of stars with motion lines circling above the head of a 



FIG. 1 IB illustrates a second position of stars with motion lines circling above the head 



monster according to an embodiment of the present invention. 
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Detailed Description 

The preferred embodiment is a system that takes a 3-dimensional (3-D) model and 
produces a non-photorealistic rendering (NPR) of the model. Non-realistic effects are added to 
make a user of the system feel more drawn into the virtual 3-D world. Real-time motion lines 
are created that follow a 3-D model to give the appearance of motion to an object. 

FIG. 1 A illustrates a first position of a sphere 100 moving in the direction of the arrow 
175 according to an embodiment of the present invention. FIG. IB illustrates a second position 
of the sphere 100 moving in the direction of the arrow 175 to which motion lines have been 
added according to an embodiment of the present invention. FIG. IB shows the sphere 100 with 
motion lines 105, 1 10, 115, 120, 125, 130 and 135 attached thereto. Each motion line 105, 110, 
115, 120, 125, 130 and 135 is attached to a vertex 140, 145, 150, 155, 160, 165 and 170, 
respectively, on the sphere 100. These motion lines 105, 110, 115, 120, 125, 130 and 135 are 
drawn in to illustrate the motion of the sphere 100. These motion lines are drawn in the opposite 
direction of the movement of the sphere 100 as shown by the arrow 175. Without the addition of 
motions lines 105, 1 10, 115, 120, 125, 130 and 135, the sphere 100 would appear static. 

The system according to an embodiment of the present invention keeps track of the 
movement of various specified points on a designated object from frame to frame and draws 
primitives for the specified points on the object. Primitives may be polygons such as drawings 
representing smoke, or motion lines showing movement, for example. The primitives are motion 
lines, as shown in FIG. 1 A, according to a preferred embodiment. The points on the object to 
which the motion lines are attached are called "vertices." Each motion line is a collection of line 
segments with associated parameters for properties such as length, width, color, starting vertex 
position, a visibility flag, etc. A set of motion lines is used to give the appearance of motion in a 



scene of an animation. The number of motion lines and the length of each motion line can be 
varied depending on aesthetic preference. A determination is made before run time as to which 
objects in a scene are to have motion lines attached. In one embodiment, an author may tag 
objects within a scene on which to attach motion lines. The author may also choose the vertices 
5 on the object on which to add the motion lines, or a program may automatically choose the 

vertices for the author. In another embodiment, each object in a series of frames may be tested to 
determine whether it has traveled over a threshold velocity for motion lines to be added. In such 
an embodiment, a program may be used to select the vertices on the object travelling above the 
threshold velocity. 

10 FIG. 2 illustrates an overview of a system according to an embodiment of the present 

ili invention. The system is comprised of three main components: a program code storage device 
4- 200, a processing xmit 205, and a display imit 215. The program code storage device 200 may be 
^} any device capable of storing program code, such as a semiconductor memory or a storage disk 

device. A function of the program code storage device 200 is to store code for a program that 
UhS adds motion lines to a scene in one frame in a series of frames. The processing unit 205 may be 

3 "if 

any device capable of executing program code. The function of the processing unit 205 is to run 
Q the program code stored on the program code storage device 200. The display unit 215 may be 

any device capable of displaying a frame with motion lines, such as a cathode ray tube (CRT) 

21 0 or a printer 220. When a real-time motion line drawing program stored on the program code 
20 storage device 200 is run to add motion lines to a series of drawn frames, the display unit 215 has 

the function of displaying the resultant frames. 

Before processing, several determinations must be made. FIG. 3 is a flow chart showing 

the information determined before real time motion lines are drawn according to an embodiment 
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of the present invention. First, the objects in a scene to which motion lines are to be drawn must 
be determined 300. Next, the vertices to which motion lines are to be attached on the objects in a 
scene to which motion lines are to be drawn must be determined 305. A circular ring buffer of a 
length that is as long as the number of points used to draw a motion line is allocated and 
5 initialized 3 1 0 for each vertex to which a motion line is to be drawn. The attributes of each 
motion line to be drawn must then be determined 315. The attributes may included data such as 
line color, a line width, etc. The system then may begin processing 320, and the motion lines 
may be drawn for each vertex to which a motion line is to be drawn. 

FIG. 4A illustrates a first iteration of a ring buffer 400 span in which data for a vertex to 
10 which a motion line is to be added is stored over a three-frame span according to an embodiment 

■psr 

J| of the present invention. FIGS. 4B and 4C illustrate the second and third iterations of the ring. 
J^= buffer span 400. The circular ring buffer 400 is n stages long. The circular ring buffer 400 is 
4| used to store the positional change of a vertex, to which a motion line is to be attached, in each of 
™" the previous n frames in an embodiment for a series of frames. A pointer 405 is used to retrieve 
iHljS the vertex position data from the circular ring buffer 400. During the first iteration, as shown in 
;;|| FIG. 4A, for a vertex 5k to which motion lines are drawn in frame k, the change in position of the 
O vertex from its position in the previous frame, frame k-1, to frame k, or Sk-^k-i, is stored in the 
starting stage 415. The position change S^tS^a is subtracted from and a line segment is drawn 
between 5k and the resulting difference, which represents the position of the vertex in frame 5k-i. 
20 Next, a similar process is used to draw a line segment is drawn between the vertex position 2 
frames earlier (5k-2) and the vertex position in the previous frame (5k.i). Line segments are also 
drawn in a similar manner between each of the other previous vertex positions (5k-3 — ► 5k-n) 
stored in the segments of the ring buffer 400. 
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Each stage of the ring buffer 400 holds a translation vector representative of the direction 
of a vertex in the previous frame. The translation vectors are used to draw motion lines. When 
the motion line for the vertex at has been completed, the frame is incremented to ^+7, and the 
difference between the positions of the vertex in the current frame k-^l and the vertex position in 
the previous frame, k, or 5'k+i-iS'k,replaces the data ^Sk-n+i - S\^.n, which was the last point on the 
motion line for the vertex *Sk in frame k, and was stored in the last stage of the ring buffer for the 
previous iteration shown in FIG. 4A. A similar process is used to draw all other segments of the 
motion line for the vertex position ^k+i. In the iteration shown in FIG. 4B, the start pointer 
begins retrieving data from the stage 435 containing the difference between 5k+i and S\^. A 
similar process is repeated for each vertex to which a motion line is to be added for the third 
iteration, as shown in FIG. 4C, and for every iteration thereafter. 

The system can attach motion lines of length n after the w th frame in a series of frames 
has been reached. For example, where «=20, the system can wait until the 21st frame to attach 
motion lines. Alternatively, the system may attach motion lines of a smaller length before the 
nth frame is reached. For example, where «=20, a NULL character representing no data for a 
segment of a motion line can initially be stored as the translation vector for every stage of the 
ring buffer 400. At the first stage, the ring buffer would be used to draw a motion line of length 
zero to a vertex S. In the second frame, the difference between Sz and Si would replace one of 
the NULL data stored in a stage of the ring buffer, and this data would be used to draw a motion 
line between the current vertex position, S2, and the previous vertex position, S\. A similar 
process would be repeated for every frame thereafter. The motion lines would become one 
segment longer for every frame up imtil the 21st frame, where the motion line would be 20 
segments long, and remain that segment length for every frame thereafter. 
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This system may also attach motion Hnes of segment length n before the «th frame in a 
series of frames has been reach if data for frames before the first frame in a series of frames is 
stored in the ring buffer before processing. During processing, similar iterations are performed 
on the ring buffer, as are in a frame after the wth frame in a series of frames. 
5 FIG. 5 illustrates a motion line and each of the line segments comprising the motion line 

according to an embodiment of the present invention. The motion line 500 is created for the 
vertex point S from the positions of S in the previous n frames. At frame k, where k>n^ Sk is the 
current position of the vertex, and Sk-i - Sk.n are the previous n positions of S, A line segment is 
dravm betv^een each of these points. These line segments comprise the motion line. Attribute 
10 data for each segment of the line is preferably stored in an array. The attribute data can be data 
JJ such as the width, color, and a visibility flag, etc., for each segment of the motion line. Where it 
4- is desirable for the portion of the motion line closest to the object whose motion is being 

•r— 

illustrated to be dark, the array can be set to make those portions darker, and make the portions 
of the motion line fiirthest away lighter, thus creating the appearance that the motion lines fade 
|4|5 as they extend fiirther away from the object to which they are attached. This array, unlike the 
ji ring buffer containing the vertex positions, can be prestored with information before processing 
Q SO that it does not have to acquire any fiirther information from each frame in a series of frames. 
For example, in FIG. 5,^4/ 520 contains attribute data for the first line segment (that drawn 
between Sk and Sk-i)^ A2 517 contains attribute data for the second line segment (that drawn 
20 between S^.j and Similarly, A„ 505 contains attribute data for the nth line segment (that 
drawn between Sk^n+i and Sk-n)* Also, A„.j 510 contains attribute data for the n-lih line segment 
(that drawn between Sic.n+2 and Sk^n+j), A„,2 5 1 5 contains attribute data for the n-2th line segment 
(that drawn between S/c.n+3 and This array can always draw each line segment the same 
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way for a vertex in each of a series of frames. In other words, in the /th frame, Aj 520 may 
contain the segment attribute data for the first line segment of a motion line drawn between 
vertex point Sj and a previous vertex point Sj.i, In the y+ith frame, A j 520 may still contain the 
segment attribute data for the first line segment of a motion line drawn for the same vertex, this 
time the segment between the points Sj+j and Sj. A similar scheme may be used for all of the 
segments. 

In the preferred embodiment, all of the processing occurs at run-time, thereby resulting in 
the motion lines being added in real-time. This method of rendering by using the positions of the 
vertex from previous frames allows the physics of an object in motion to be more clearly 
illustrated. For example, if it is necessary to show an object moving in a zig-zag direction, or 
moving in a circular direction, this system may show the motion lines based on the 
aforementioned previous vertex positions to clearly show the physics of the object in motion. 
Moreover, an object that is changing directions and undergoing a change in speed can also be 
clearly shown. 

FIG. 6 illustrates a process of adding motion lines to a drawing according to an 
embodiment of the present invention. First, attribute information for the motion line to be drawn 
is stored 600 in an array. This attribute information is information such as the previous vertex 
positions for a vertex to which a motion line is to be drawn, line thickness, color, etc. Next, a 
ring buffer is provided 605 in which this data for the previous positions of a vertex to which a 
motion line is to be attached is stored. A pointer is then used to retrieve 610 the position data 
from the ring buffer. Next, the motion lines are added 615 in real time to vertices to which they 
correspond, and the resultant model is displayed 620. 
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An author may select objects in a frame in a series of frames to which motion lines are to 
be attached. Alternatively, a program may be utilized to select objects to which to attach motion 
lines. Such a program may select an object to which to attach motion lines based on criteria such 
as the object's relative velocity or acceleration. FIG. 7 illustrates a process by which motion 
lines are automatically added to objects exceeding a threshold velocity in a frame of a series of 
frames according to an embodiment of the present invention. First, the starting frame must be 
selected. Frame m, for example, may be the starting frame 700. Next, the velocity of all objects 
in motion in frame m is determined 705 by the relative change of position of each object based 
upon each of their positions in previous frames. Next, the program determines 710 whether any 
of the objects in motion exceed a predetermined threshold velocity. For all objects exceeding the 
threshold, motion lines are attached 715 to those objects' vertices. Next, the frame counter is 
incremented 720 so that during the next iteration, the frame is m+7. The process then repeats for 
frame m+i, beginning with the velocity determination 705. A similar process is used for all 
successive iterations. 

The author may select the vertices to which motion lines are to be attached before 
processing, or a program can determine them. FIG. 8 illustrates a process by which vertices are 
automatically determined by a process according to an embodiment of the present invention. 
First, data for an object to which motion lines are to be attached is loaded 800. This data may 
contain information such as the location of the object in the frame, as well as the shape of the 
object. Next, the program determines whether vertices have already been determined 805 for the 
object. This determination prevents the program from adding motion lines to different vertices 
of an object throughout a series of frames. If the vertices have not been determined, the program 
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then determines 810 the best vertices on the object to which to attach the motion lines. The 
vertices' positions are then stored 815 in a file. 

FIG. 9A illustrates a solid box 900 travelling at a first constant velocity in the direction of 
the arrow 925, to which parallel motion lines 905, 910, 915, and 920 have been drawn according 
to an embodiment of the present invention: This motion is evidenced by the direction of the 
motion lines 905, 910, 915, and 920. The vertices of the box 900 are moving in a uniform 
direction, with each vertex moving in the same direction at the same speed, as is illustrated by 
virtue of the fact that the motion lines 905, 910, 915, and 920 are parallel to each other and are 
all the same length. Data from the positions of the vertices in the previous n frames is used to 
drawn the motion lines 905, 910, 915, and 920. The length of each of each of these uniform 
motion lines is p. 

FIG. 9B illustrates the solid box 900 travelling at a second constant velocity, equal to 
twice that of the first velocity of the box 900 in FIG. 9 A, in the direction of the arrow 945, to 
which parallel motion lines 925, 930, 935, and 940 have been drawn according to an 
embodiment of the present invention. The vertices of the box 900 are moving in a uniform 
direction, with each vertex moving in the same direction at the same speed, as is illustrated by 
virtue of the fact that the motion lines 925, 930, 935, and 940 are parallel to each other and are 
all the same length. Data from the positions of the vertices in the previous n frames is used to 
draw the motion lines 925, 930, 935, and 940. The length of each of these uniform motion lines 
is 2p, which is twice as long as the motion lines 905, 910, 915, and 920 in FIG. 9A, since the 
constant velocity of the box 900 in FIG. 9B is twice that of the constant velocity of the box in 
FIG. 9A. 



12 



FIG. 9C illustrates the solid box 900 travelling at a second constant velocity, equal to 
thrice that of the first velocity of the box 900 in FIG. 9A, in the direction of the arrow 970, to 
which parallel motion lines 950, 955, 960, and 965 have been drawn according to an 
embodiment of the present invention. The vertices of the box 900 are moving in a uniform 
direction, with each vertex moving in the same direction at the same speed, as is illustrated by 
virtue of the fact that the motion lines 950, 955, 960, and 965 are parallel to each other and are 
all the same length. Data from the positions of the vertices in the previous n frames is used to 
draw the motion lines 950, 955, 960, and 965. The length of each of these uniform motion lines 
is 3p, which is thrice as long as the motion lines 905, 910, 915, and 920 in FIG. 9A, since the 
constant velocity of the box 900 in FIG. 9B is thrice that of the constant velocity of the box in 
FIG.'9A. 

FIG. lOA illustrates a first position of a solid box-shaped object according to an 
embodiment of the present invention. This box 1000 is moving in forward (to the right) as 
indicated by the straight arrow 1035 and rotating in a counterclockwise direction, as indicated by 
the circular arrow 1030. FIG. lOB illustrates a second position of the solid box-shaped object 
which is moving away from its first position and experiencing a positive angular velocity in a 
counter-clockwise direction, to which motion lines 1005, 1010, 1015, 1020, and 1025 have been 
drawn according to an embodiment of the present invention. The motion lines in FIG. lOB 
illustrate that the box 1000 is imdergoing a horizontal velocity as well as an angular velocity in a 
counter-clockwise direction. The bottom motion line 1025 is longer and more curved than the 
one 1020 above it, which is also longer and more curved than the one above it, and so on. These 
motion lines 1005, 1010, 1015, 1020, and 1025 serve to illustrate the horizontal and angular 
velocities. Other types of movements can also be illustrated, such as the movement of a non- 
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rigid object, where each vertex undergoes a different movement, or a situation vi^here multiple 
objects are moving in different directions at different speeds within a series of frames. 

FIGS. 1 1 A-1 IC illustrate a monster 1 100 with stars 1105, 1 1 10 and 1 1 15 flying around 
his head in a circular manner, relatively parallel to the ground. Motion lines 1 120, 1 125, and 
1130 follow each of the stars 1 1 05, 1 1 1 0 and 1115 and serve to show the direction of the 
movement of these stars. In FIG. 1 1 A, a star 1 105 is circling the monster's 1 100 head, as 
evidenced by the accompanying motion lines 1 120. The star 1 105 is directly over the back of the 
monster's 1 100 head. In FIG. 1 IB, the star 1 105 has continued moving in its circular path, and 
now is behind the monster's 1 100 right ear. The accompanying motion lines 1 120 have also 
moved and track the previous path of the vertices on the star 1 105 to which they are attached. In 
FIG. 1 IC, the star 1 105 has continued in its circular trajectory and has passed around the 
monster's 1 100 right ear. The motion lines 1 120 also track the movement of the star 1 105. 

The star 1110 that is located below the monster's 1 100 right ear in FIG. 1 1 A has its own 
accompanying motion lines 1 125. Another star 1 1 1 5 is located below and to the left of the 
monster's 1 100 left ear in FIG. 1 1 A. The star 1115 also has its own accompanying motion lines 
1 130. These stars 1 1 10 and 1115 undergo similar movements as the star 1 105 that began its 
circular path in FIG. 1 1 A above the back of the monster's 1 100 head. 

While the description above refers to particular embodiments of the present invention, it 
will be imderstood that many modifications may be made without departing from the spirit 
thereof The accompanying claims are intended to cover such modifications as would fall within 
the true scope and spirit of the present invention. The presently disclosed embodiments are 
therefore to be considered in all respects as illustrative and not restrictive, the scope of the 
invention being indicated by the appended claims, rather than the foregoing description, and all 
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changes which come within the meaning and range of equivalency of the claims are therefore 
intended to be embraced therein. 
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